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\o  x\  \n 


Abstract 

Spectral  analysis  has  emerged  as  an  exciting  tool  in  complexity  research.  In  some  cases,  the 
functions  in  a  complexity  class  can  be  characterized  by  specifying  a  simple  property  of  their 
Fourier  spectra — even  though  their  truth  tables  do  not  display  such  simple  properties. 

In  this  paper,  we  demonstrate  a  fundamental  limitation  of  this  tool:  if  a  class  of  func¬ 
tions  contains  parity  and  is  closed  under  some  simple  composition  rules,  then  we  can  take 
the  set  of  Fourier  spectra  of  a  subset  of  that  class,  close  it  under  some  simple  projections, 
and  obtain  everything  in  the  original  class.  Indeed,  we  can  demonstrate  this  property  for 
a  general  family  of  transforms,  of  which  the  parity-based  Fourier  transform  is  only  one.  If 
a  class  contains  the  basis  function  of  such  a  transform,  then  no  reduction  in  complexity  is 
obtained  when  we  shift  from  truth  tables  to  spectra. 


1.  Introduction 


1.1.  Spectral  Approaches  to  Complexity 

Complexity  classes  are  usually  defined  in  terms  of  resources;  they  are  the  classes  of  functions 
that  can  be  computed  by  some  family  of  devices:  contant-depth  circuits,  Turing  machines 
with  polynomial  space  and  time,  et  cetera.  The  central  problem  in  computational  complexity 
is  that  in  general  it  is  difficult  to  actually  characterize  these  classes  of  functions.  What  really 
can  be  computed  by  some  given  family? 

Spectral  analysis  has  recently  been  shown  to  be  a  way  to  solve  this  problem  in  some  cases. 
Traditionally,  functions  are  regarded  as  truth  tables:  lists  of  input-output  pairs.  There  may 
be  no  apparent  pattern  to  the  set  of  functions  calculated  by  some  family  of  devices  when 
we  write  the  functions  as  truth  tables.  But  if  we  look  at  their  Fourier  spectra,  patterns 
sometimes  emerge.  The  most  well-known  spectral  result  is  Linial,  Mansour  and  Nisan’s  [14] 
theorem  that  the  Fourier  spectrum  of  a  function  computed  by  an  AC 0  circuit  diminishes 
exponentially  with  “frequency”,  but  there  has  been  a  good  deal  of  other  spectral  work  as 
well  [4]  [6]  [7]  [8]  [11]. 

What  exactly  is  the  Fourier  transform  of  a  Boolean  function?  If  we  embed  the  Booleans 
in  the  reals  by  identifying  true  and  false  with  ±1,  then  the  real  functions  on  n  Boolean 
variables  can  be  thought  of  as  a  real  2"  dimensional  vector  space.  A  natural  basis  is 

{£s  :  5  C  {l,...,n}} 

where  8S  takes  the  characteristic  vector  for  5  to  1  and  everything  else  to  0.  This  space  is 
isomorphic  to  R2  ;  the  8s  correspond  to  the  standard  axes,  and  the  Boolean  functions  cor¬ 
respond  to  the  corners  of  the  unit  hypercube.  However,  there  is  a  class  of  parity  functions — 
diagonals  on  this  cube — that  also  forms  a  nice  basis  for  this  space.  Researchers  use  the  term 
“Fourier  spectrum”  to  refer  to  the  coordinates  of  a  function  with  respect  to  this  alternate 
basis.  (Alternatively,  this  is  known  as  the  Walsh- Hadamard  Transform  [1].) 


1.2.  Fixed  Points  in  Spectral  Complexity 
Let  us  first  define  some  notation. 


Definition  1  (T,  7T)  If  C  is  a  collection  of  functions,  let  TT(C)  denote  the  set  of  truth 
tables  of  those  functions.  IfT  is  a  transform  on  the  class,  let  T(C )  denote  the  set  of  spectra 
of  functions  in  that  class  with  respect  to  to  the  transform  T. 


Definition  2  If  S  is  a  set  of  truth  tables  (or  spectra  being  regarded  as  truth  tables ),  let  S’ 
be  the  truth  table  set  obtained  by  closing  S  under  polynomial  projection  and  constant  depth , 
constant  size  composition. 
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The  main  thrust  behind  spectral  complexity  research  is  that  the  set  F(C)  of  Fourier 
spectra  of  functions  in  some  class  C  are  somehow  simpler  than  the  set  of  truth  tables 
TT{C).  We  demonstrate  a  fundamental  limitation  of  the  spectral  approach:  under  very 
general  conditions,  once  a  class  contains  parity,  then  a  subset  of  its  Fourier  spectra  looks 
exactly  like  the  set  of  truth  tables  for  the  class.  No  reduction  in  complexity  is  obtained  by 
shifting  from  truth  tables  to  spectra.  We  also  establish  a  similar  result  for  a  more  general 
family  of  transforms. 

We  establish  this  result  in  the  parity  case  by  regarding  Fourier  spectra  as  truth  tables 
and  examining  the  eigenvectors  of  the  Fourier  transform.  We  obtain  the  surprising  fact  that 
Boolean  functions  can  be  eigenvectors — and  that  these  functions  can  be  arbitrarily  complex. 
Namely,  for  any  Boolean  function  /  there  exists  a  Boolean  function  g  such  that 

•  g  is  fixed  under  the  Fourier  transform — that  is,  its  Fourier  spectra  differs  from  its  truth 
table  only  by  a  multiplicative  constant; 

•  /  can  be  obtained  from  g  by  a  polynomial  projection; 

•  and  computing  g  reduces  to  computing  /,  parity,  and  some  two-bit  functions. 

Let  C  be  a  class  of  functions  closed  under  constant-depth  finite-sized  composition  and 
containing  the  two-bit  functions.  (Any  standard  complexity  class  has  this  property.)  If  C 
contains  parity,  then  it  contains  the  fixed  point  g  for  every  /  in  C.  Hence,  the  set  of  Fourier 
spectra  of  functions  in  C  contains  a  subset  of  things  that  look  just  like  Boolean  functions. 
So  we  cannot  obtain  any  nice  dropoff  invariants  for  the  spectra.  If  we  close  this  subset  under 
polynomial  projection,  then  we  obtain  exactly  the  set  of  truth  tables  of  functions  in  C.  That 
is: 

TT(C)  C  F{C)m 

Therefore  the  set  of  spectra  of  functions  in  the  class  C  contains  a  subset  that  is  just  as  hard 
to  characterize  as  is  the  set  of  truth  tables  of  functions  in  C. 

It  is  interesting  to  note  that  this  phenomenon  of  spectra  coinciding  with  truth  tables 
occurs  with  the  parity-based  Fourier  transform  when  the  class  C  contains  parity.  Indeed, 
we  can  show  that  this  generalizes  to  other  transforms  F^,,  when  the  class  includes  the  basis 
functions  <f>  of  the  transform.  For  any  class  C  of  functions. 

KC  AC  =  C’  =»  TT{C)  C  F*(C)‘ 

We  no  longer  obtain  individual  functions  as  fixed  points,  but  the  notion  of  spectra  of  a  class 
having  the  same  complexity  as  the  truth  tables  still  hold. 

In  Section  2,  we  present  an  eigenvector- based  proof  of  the  result  for  the  parity  based 
Fourier  transform.  In  Section  3,  we  present  the  general  proof,  which  uses  only  the  orthogo¬ 
nality  of  the  transform  and  its  self-similarity  for  different  domain  sizes.  The  parity  theorem 
follows  from  the  general  theorem  as  a  simple  corollary. 
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2.  Boolean  Fixed  Points  of  the  Fourier  Transform 


If  we  identify  true  and  false  with  +1  and  —1  respectively,  we  can  embed  Boolean  functions 
on  n  bits  in  the  space  of  real  functions  on  n  bits.  A  natural  way  to  represent  a  real  function 
f  on  n  Boolean  variables  is  as  its  generalized  truth  table:  a  list  of  the  values  /  takes  on  for 
the  2n  possible  input  vectors.  Fourier  analysis  provides  an  alternative  way:  each  subset  S  of 
{l,...,n}  defines  a  parity  function  <f>s,  and  a  function  /  can  be  uniquely  represented  as  the 
vector  of  its  correlations  with  these  functions. 

If  we  identify  subsets  of  {l,...,n}  with  their  characteristic  Boolean  vectors,  then  the 
Fourier  transform  of  a  function  on  n  bits  is  itself  a  function  on  n  bits.  Regarding  the 
Fourier  transform  as  a  map  from  functions  to  functions  rather  than  from  coordinate  axes  to 
coordinate  axes  provides  new  insight  into  the  action  of  the  Fourier  transform.  The  Fourier 
transform  F  induces  two  orthogonal  2n_1  dimensional  spaces  of  eigenvectors.  Everything  in 
the  one  space  is  fixed  by  F;  everything  in  the  other  is  negated.  Hence  any  function  may  be 
written  as  the  sum  of  a  fixed  and  an  alternating  component;  the  transform  simply  negates 
the  alternating  component  and  multiplies  everything  by  a  positive  constant. 

Our  research  also  yields  the  surprising  result  that  these  fixed  point  subspaces  contain 
Boolean  functions.  In  particular,  every  Boolean  function  /  is  the  polynomial  projection  of 
some  Boolean  fixed  point  g  with  the  property  that  computing  g  reduces  to  computing  /  and 
parity. 


2.1.  Fourier  Analysis  of  Boolean  Functions 

The  idea  of  applying  Fourier  analysis  to  Boolean  functions  is  discussed  in  great  detail  else¬ 
where  [14],  so  we  shall  only  provide  a  quick  overview. 

First,  we  define  the  space  of  functions  acted  on  by  the  Fourier  transform. 


Definition  3  Define  F(Bn, R)  to  be  the  space  of  real  functions  on  n  Boolean  variables. 


Let  us  identify  ti~ue  and  false  with  1  and  —1,  respectively.  Then  ,F(i?n,R)  also  contains 
the  Boolean  functions  on  n  bits. 

Definition  4  For  S  C  {l,...,n},  let  as  be  the  characteristic  Boolean  vector  for  S.  Let  As 
be  the  function  that  takes  as  to  1  and  any  other  vector  to  zero.  Define  4>s{aj)  —  —  llsnTl. 
For  two  functions  f,g  €  J~{Bn,  R)  define  their  inner  product  <  f,g  >  =  f(as)g{as). 


Note  that  this  definition  also  differs  from  that  used  elsewhere  [14]  in  that  we  don’t  divide 
by  2n  when  computing  the  inner  product.  This  conveniently  ensures  that  the  inner  product 
of  Boolean  functions  is  always  an  integer. 
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The  natural  representation  for  a  function  /  €  .F(i?n,R)  is  its  truth  table.  We  can  restate 
this  in  terms  of  linear  algebra:  the  functions  As  form  an  orthonormal  basis  for  F(Bn,TL) 
under  the  inner  product  <>.  The  main  idea  of  Fourier  analysis  on  Boolean  functions  is  that 
the  functions  <f>s  form  a  basis  for  ^(B",  R)  that  is  almost  orthonormal:  <  <pr  >  is  zero 
if  S  ^  T  and  2n  otherwise.  The  Fourier  transform  of  a  function  is  just  its  coordinates  in  this 
basis.  If  we  identify  the  subsets  of  {1,  ...,n}  with  their  characteristic  Boolean  vectors,  then 
the  transform  itself  is  in  Jr(Bn,TL). 

Definition  5  For  f  €  IF(Bn,'R),  define  its  Fourier  transform  Ff  €  ^(Bn,R)  as 

Y,<f,<t>s>As 

s 

2.2.  The  Eigenspaces  of  the  Fourier  Transform 
2.2.1.  Preliminaries 

Let  us  recall  some  definitions  from  linear  algebra. 


Definition  6  A  nonzero  vector  v  is  an  eigenvector  of  a  linear  transformation  G  if  Gv  =  cv 
for  some  nonzero  c.  Such  a  c  is  an  eigenvalue  of  G.  The  set  of  eigenvectors  associated  with 
some  eigenvalue  forms  a  subspact. 


Since  the  Fourier  transform  F  is  easily  shown  to  be  a  linear  transformation  on  P(Bn,  R), 
it  is  natural  to  ask  what  its  eigenvalues  and  eigenvectors  are.  We  can  directly  observe  that 
for  any  function  /,  F2  f  —  2 nf.  So  if  a  real  c  has  the  property  that  some  nonzero  /  satisfies 
Ff  =  cf  then  c2  =  2n.  Hence  the  only  possible  eigenvalues  for  /  are  ±2? . 


Definition  7  When  n  is  fixed,  define  c  =  2? . 


2.2.2.  Tensor  Product  Decomposition 

The  function  space  .F(Bn,R)  decomposes  nicely  as  the  tensor  product  (Section  28  in  Curtis 
[5])  of  smaller  spaces.  We  can  quickly  deduce  the  following  from  basic  definitions. 


Lemma  8  If  positive  integers  n\,  ...,nk  satisfy  n  =  then 

^(Bn,R)  =  jF(Bni,R)®^(Bnj,R)®  ...®^(Bn*,R) 

Lemma  9  If  f,g  €  F{Bk,  R)  and  f',g'  e  F{Bk' ,  R)  then  <  f  <g>  f,g  <g>  g'  >=<  f,g  >< 
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The  Fourier  transform  decomposes  similarly. 


Definition  10  Let  Fk  denote  the  Fourier  transformation  on  R) 


A  straightfoward  manipulation  of  definitions  establishes  the  following. 


*•  Theorem  11  If  positive  integers  ni,  satisfy  n  =  £  ri{  then  Fn  =  Fn,  ®F„2  Fn, . 


2.2.3.  The  Eigenspaces 

The  results  in  Section  2.2.2  provide  a  simple  way  to  completely  characterize  the  eigenvectors 
of  F. 

Define  P,N  €  IF{Bl,  R)  (in  the  truth  table  basis)  by  N  = 

Observe  that  <  P,N  >=  0  and  that  FP  =  cP  and  FN  —  —cN.  Apply  Lemma  9. 


Lemma  12  The  vectors  of  the  form  G\  ®  ...  ®  Gn ,  where  each  G,  6  {P,  N},  form  an 
orthogonal  basis  for  Jr(Bn,R). 


Theorem  13  The  eigenvalues  of  F  are  ±c.  The  subspaces  of  eiegenvectors  associated  with 
each  have  dimension  2”*1 . 


Proof:  Consider  the  vectors  from  Lemma  12.  The  2n_1  of  them  with  an  even  number  of 
N  factors  form  an  orthogonal  basis  for  the  c  subspace;  the  other  half  form  one  for  the  — c 
subspace.  □ 


Definition  14  Let  us  call  the  subspace  of  eigenvectors  associated  with  c  the  positive  eiegenspace 
of  F .  Define  the  negative  eigenspace  similarly. 


Corollary  15  Any  f  €  F"(Bn,  R)  can  be  written  uniquely  as  f+  +  f~,  where  f+  is  in  the 
positive  eigenspace  and  f~  in  the  negative.  Further,  Ff  =  cf+  —  cf~. 


2.3.  Boolean  Fixed  Points 

The  eigenspaces  of  F  contain  Boolean  functions  that  are  exactly  as  computationally  hard 
as  we  desire.  We  will  demonstrate  this  by  embedding  arbitrary  Boolean  functions  in  com¬ 
putationally  equivalent  Boolean  fixed  points. 
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In  the  sequel  we  will  be  constructing  functions  onn  +  2  bits  from  functions  on  n  bits.  For 
h  €  ^’(Sn+J,  R),  if  the  restrictions  of  h  on  the  last  two  bits  are  h _ ,  /i_+,  A+_,  h++  then  we 

may  write  h  as  the  matrix 


(  h-+  A++  \ 
\h-  A+_| 


Lemma  16  For  f,g  €  ^(Bn,R)  define  h  €  ,F(i?n+2,R)  by  h 

_  (  -2 Ff  2 Fg  \ 

Fh  ~  [  2 Fg  2Ff  ) 


Lemma  17  Let  f,g,h  be  as  in  Lemma  16.  If  F f  =  —cf  and  Fg  =  eg  then  h  is  in  the 
positive  eigenspace  of  Jr(Bn+2,  R).  If  F f  —  cf  and  Fg  =  —eg  then  h  is  in  the  negative 
eigenspace. 
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Definition  18  For  arbitrary  Boolean  functions  f  on  n  bits,  define  Boolean  functions  FP+(f) 
and  FP~(f)  on  2n  +  2  bits  inductively  as  follows.  If  n  =  0,  f  must  be  constant.  Define 
FP+(f)  =  f  AND  and  FP~(f)  =  /  OR  where  AND  and  OR  are  functions  on  2  bits. 
If  n  >  0,  restrict  f  on  xn  and  to  obtain  n  —  1  -bit  functions.  Then  define 


FP+(f)  =  ( 
Fp-(f)  =  ( 


FP-(f\,..-,)  FP+(f\,„=,) 

FP+U\*--i)  -FP-U 1,.=-,) 

FP*U\,.-i)  FP-(f\,n= ,) 

FP-(fU..i)  -FP*U\,„=-i) 


) 

) 


Lemma  19  For  any  Boolean  f,  FP+{f)  is  in  the  positive  eigenspace  and  FP~(f)  is  in  the 
negative. 


Proof:  AND  €  T(B2,1A)  is  in  the  positive  eigenspace  and  OR  is  in  the  negative.  Apply 
Lemma  17.  □ 


Lemma  20  For  arbitrary  Boolean  f,  f(xu...,xn)  =  FP±(f)(l,  1,  xu  l,x2, 1,  1). 

Proof:  Unravel  the  definition  of  FP±:  the  x„,  1  assigned  to  the  rightmost  variables  selects 
the  FP  of  the  appropriate  restriction  of  /  on  xn.  □ 

It  is  not  surprising  that  /  reduces  to  its  fixed  points.  What  is  surprising  is  that  if  we  can 
do  parity,  the  fixed  points  reduce  to  /. 

Lemma  21  There  exist  constants  ct,C2,C3  such  that  for  any  Boolean  f  €  F(Bn,H)  if 
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•  f  is  computed  by  a  circuit  C  with  gj  gates  and  depth  df 

•  parity  on  n  bits  is  computed  by  a  circuit  with  gp  gates  and  depth  dp 

then  FP+(f)  is  computed  by  a  circuit  with  not  more  than  gj  +  2gp  +  c^n  +  c2  gates  and  of 
depth  not  more  than  ma x(dp,d/)  -f  c3.  A  similar  result  holds  for  FP~(f). 


Proof:  Label  the  variables  in  F(B2n+2, R)  as  <  wx,w2,  yx,  zx,y2,  z2, ..., y„,  zn  >  and  use  the 
standard  labeling  <  xi,...,xn  >  for  the  variables  in  ^(5n,R). 

From  its  definition  we  see  that  FP+(f)  equals  ±FP±(f The  sign  out  front 
follows  y„  V  zn;  the  sign  in  the  exponent  follows  yn  ©  zn.  Telescoping,  we  see  that 

FP+(f)(  1, 1,  yu  zi, ... ,yn ,  zn) 

can  be  computed  by  calculating  f(yx  ©  zx,  ...,yn  ©  z„)  and  negating  this  value  if  there  are  an 
odd  number  of  —Is  in  the  n  bits  y,  V  z,-.  However,  when  the  first  two  bits  wx  and  w2  are  not 
both  1,  we  need  to  know  which  0-bit  fixed  point  was  used,  AND  or  OR.  This  is  determined 
by  the  parity  of  the  n  bits  yi  ©  Z{. 

So  we  calculate  f(yx  ©  z u  ...,y„  0  z„ ),  negate  depending  upon  the  parity  of  the  y,  Vz,,  and 
then  NOT-EXCLUSIVE-OR  against  AND( wx,w2)  or  OR(w x,w2)  depending  on  the  parity 
of  the  y,-  ©  Zi.  □ 


Theorem  22  For  any  Boolean  function  f  on  n  bits  there  exist  Boolean  function  g ,  h  on 
2n-f-2  bits  such  that  Fg  =  eg,  Fh  =  —  ch,  f  is  a  polynomial  projection  of  g  and  h,  and  g  and 
h  both  reduce  to  calculating  one  instance  of  f,  two  instances  of  parity,  and  a  linear  number 
of  two-bit  Boolean  functions. 


We  have  also  proven  [16]  a  companion  result  to  Theorem  22:  representatives  of  each  class 
exist  which  cannot  be  obtained  by  taking  the  Sign  of  anything  in  the  eigenspaces. 

Theorem  22  gives  us  the  following  directly. 


Theorem  23  Let  C  be  a  class  of  functions  containing  the  two-bit  functions  closed  under 
constant  depth,  polysize  composition.  If  C  contains  parity,  then  TT(C)  C  F(C)m. 

In  Section  3  we  will  prove  a  stronger  version  of  this  theorem. 


3.  A  General  Theorem 


We  now  generalize  the  results  of  Section  2.  In  particular,  we  generalize  Theorems  22  and  23 
to  apply  for  more  general  families  of  transforms. 
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3.1.  Preliminaries 


3.1.1.  Functions 


Consider  complex  functions  on  some  finite  group  D. 

Definition  24  (T)  Let  iF(A,B)  be  the  set  of  functions  from  A  to  B. 


Definition  25  (S)  For  d  G  D  define  6*  G  F(D,  C)  by 

-  { li 


if  x  —  d 
otherwise 


Then  can  be  conceived  of  as  a  |Z?|-dimensional  vector  space  over  C  with  canonical 

basis  {Sd  :  d  G  D}.  The  coordinates  of  a  function  in  this  basis  is  just  its  truth  table:  the 
values  it  takes  on  for  each  element  of  D. 

Further,  the  standard  inner  product  for  complex  vector  spaces  conveniently  relates  to  the 
correlation  between  two  functions. 


Definition  26  For  f,g€  f(D,E)  define  their  inner  product 

<f\9>=  ]£  /(%(<*) 

d€D 


The  following  is  no  surprise. 

Lemma  27  The  6  basis  is  orthonormal. 


In  our  parity  work,  we  had  two  levels  of  functions  on  Boolean  variables:  those  that  mapped 
into  the  reals,  and  those  that  mapped  into  ±1 — the  natural  embedding  of  the  Booleans  in 
the  reals.  The  surprise  came  in  that  while  transforms  of  the  smaller  level  are  generally  in 
the  larger,  there  existed  functions  in  the  small  level  whose  transforms  (when  multiplied  by 
a  constant)  were  still  in  the  small  level. 

This  suggests  that  we  want  to  identify  a  special  subclass  of  functions  in  iF(D,E). 

Definition  28  (W,  W',  k)  Let  W  be  a  finite  group,  and  let  W'  be  a  representation  of  it  in 
C.  Let  \W\  =  k. 

Because  W  is  a  finite  group,  we  have  that  w  G  W'  =>  w  G  W' .  Also,  0  G  W  maps  to 
1  G  W'  C  C. 

So  our  special  class  will  be  iF(D,W').  In  general,  D  will  turn  out  to  be  n-tuples  of  W 
(that  is,  we  currently  cannot  think  of  anything  else  interesting  for  D  to  be). 
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3.1.2.  Transforms 


We  need  to  generalize  the  idea  of  the  parity  transform. 

In  the  parity  case,  we  specified  an  alternate  orthonormal  basis  for  the  general  function 
class  (i.e.,  The  functions  in  the  new  basis  were  all  in  the  smaller  class  (i.e., 

nD,w)). 

So  we  need  to  specify  a  new  basis  for  F(D, C)  consisting  of  functions  from 
In  order  for  the  transform  to  be  a  self-map  of  the  function  space,  we  need  to  identify  each 
new  basis  function  with  an  element  of  D.  Since  there  are  |D{  elements  in  the  new  basis,  we 
specify  this  identification  explicitly  by  indexing  the  new  basis  by  D —  {fa  :  d  £  D}. 

The  complexity  fixed  point  theorem  for  parity  works  by  considering  complexity  classes 
that  contain  parity.  Conveniently,  the  basis  functions  for  the  parity  transform  are  merely 
smaller  versions  of  parity.  When  we  generalize  the  transform  this  property  may  no  longer 
hold,  so  we  need  a  way  of  generalizing  the  condition  on  the  complexity  class. 

Since  the  new  basis  consists  of  \D\  functions,  indexed  by  £>,  from  D  to  W',  we  can  regard 
the  basis  as  a  whole  as  a  function  from  D2  to  W. 

We  can  now  make  the  following  definitions. 


Definition  29  Let  <j>  €  F[D2,  W).  Let  fa  be  the  restriction  of  <f>  on  its  first  variable — e.g., 
4>d,(d2)  =  <t>{di,d2).  The  transform  F 4  induced  by  <j>  on  F(D,C)  is  defined  by 


F*f  =  <  f  > 

d£D 


The  transform  is  orthonormal  when  the  fa  satisfy 


<  4>dx ,  fa2 


\D\ 

0 


if  d\  —  d2 
otherwise 


We  will  write  F  for  F+  when  <i>  is  understood. 


3.1.3.  Bigger  Domains 

We  observe  that,  as  in  all  complexity  theory,  we  are  only  pretending  to  be  working  with 
one  particular  F{D,  W').  I.i  reality,  we  have  a  family  V  of  domains  of  increasing  size.  The 
domains — usually  tuples  of  variables — are  built  up  by  adjoining  smaller  domains.  Functions 
on  the  smaller  domains  can  be  combined  to  obtained  functions  on  the  larger  in  a  natural 
way  using  tensor  products. 

Similarly,  we  talk  about  a  function  <j>  that  operates  on  D  x  D  but  we  really  mean  a  family 
of  <f>,  one  for  each  D.  The  orthogonal  transform  <j>  on  a  family  of  domains  V  acutally  consists 
of  a  family  of  transforms,  one  for  each  D  €  T>. 
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There  is  a  natural  way  to  combine  orthogonal  transforms  on  two  domains  D\  and  D2  to 
obtain  one  on  D\  x  D?.  We  engage  in  a  slight  abuse  of  notation. 


Definition  30  Suppose  fa  and  fa  are  transforms  on  and We  can  define 

a  transform  fa  ®  fa  on  the  function  space  J-(D\  x  D2, C)  by 

{fa®fa)(<a1,a2>,<bi,b2>)  =  fa(aub1)fa(a2,b2) 


for  ai,bi  6  A- 

We  used  tensor  product  notation  for  the  combined  transform  because  in  pretty  much 
every  sense,  the  transform  is  a  tensor  product.  Each  basis  element  in  the  new  basis  is  the 
tensor  product  of  basis  elements  in  the  smaller  ones.  Further,  there  is  the  following  directly 
obtained  fact. 


Lemma  31  For  <  fi,f2  >€  f(Di  x  D2,E), 

®<h  <  /11/2  >  =  A1/1  ®  F<hh 

Orthogonality  and  orthonormality  are  also  preserved. 


Lemma  32  If  fa  and  fa  are  orthogonal  [orthomormal]  transforms,  then  so  is  fa  0  fa. 

So  when  we  talk  about  about  a  transform  <f> ,  we  really  mean  a  hierarchy  of  transforms, 
one  for  each  domain. 


Definition  33  Suppose  for  all  domains  D,  the  transform  (f>  on  D 2  is  just  the  tensor  square 
of  the  transform  <f>  on  D ,  as  per  Definition  30.  We  then  say  that  <f>  is  multiplicative. 


3.2.  The  General  Theorem 

In  this  section  we  prove  our  general  fixed-point  theorem.  We  actually  obtained  this  result 
by  directly  generalizing  the  Boolean  parity  case.  Once  we  obtained  this  result,  it  became 
possible  to  prove  it  directly.  We  use  the  direct  approach  here. 

Theorem  »i4  Let  f  6  F(D,W')  and  let  Fj,  be  an  orthogonal  transform.  Then  there  exist 
g,h  6  iF(D2,  W')  such  that 

•  g,  h  reduce  to  each  other  and  <j> 

•  F*q+9  =  \D\h 
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•  f  is  a  polynomial  projection  of  g 

•  g  and  h  reduce  to  f  and  <j> 


If  (j>(a,b)  =  4>(b,a)  then  g,h  reduce  to  just  each  other. 

Proof:  Given  /  and  <f>,  define 

g(a,  b )  =  f{a)<t>(a ,  6),  h(a ,  b)  =  f(b)<j>(a,  b) 

Then 


=  <g\d>®<i>a,b> 

(by  definition  of  F^j,) 

=  E c.aeD  9(c>d)  4>®<K  (*,b),  ( c,d )  ) 

(by  definition  of  inner  product) 

=  Ec,aer>  /(c)<£(c,d)  ( a,b ),  (c,d)  ) 

(by  definition  of  g) 

=  Ec,aeD  /(c)^(c,  d)  <t>(a,c)  <j>(b,d) 

(by  definition  of  <$  (gj  </») 

=  EceJD  f(c)  4>{a,c)  E dtD  <t>(c,d)  <KM) 

(rearranging  sums) 

=  Ec€D  f(C)  <?Ka,  C )  <  <f>c\<f>b  > 

(by  definition  of  inner  product) 

□ 

\D\  f(b)  <f>(a,b) 

(by  orthonormality  of  <f>) 

We  can  use  the  existence  of  g  and  h  to  demonstrate  the  existence  of  complexity  classes 
that  are  fixed  under  the  truth  table  to  spectral  transformation. 

Theorem  35  Let  W  be  a  finite  group  and  let  <f>  be  a  multiplicative  orthonormal  transfor¬ 
mation  on  iF(D,  W').  Suppose  C  C  F(D,W')  satisfies 

•  C  =  Cm 

•  C  can  calculate  W -negation  and  2-way  W -addition. 

If  C  can  calculate  <f>,  then 

tt(C)  c  F^cy 


3.3.  Group  Characters 

Now  that  we  have  established  a  nice  theorem  about  orthogonal  transforms  and  T{D,  W) 
for  finite  groups  W,  it  would  be  nice  to  demonstrate  the  existence  of  interesting  transforms 
that  meet  the  criteria  of  the  theorem. 

Group  representation  theory  [12]  [13]  provides  such  a  family  of  tranforms.  The  simple 
characters  of  a  group  W  are  complex  functions  on  W  that  are  pairwise  orthogonal.  The 
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inner  product  of  a  simple  character  with  itself  is  k.  Suppose  W\ , . . . ,  WT  axe  the  conjugacy 
classes  of  W:  then  there  are  r  simple  characters,  each  of  which  is  fixed  on  each  W{.  Further, 
simple  characters  of  W  combine  to  form  simple  characters  on  Wn  exactly  the  way  we  want 
them  to  (eg,  as  per  Definition  30):  they  multiply. 

This  suggests  that  if  the  simple  characters  are  to  form  the  alternate  basis  for  our  function 
space  W'),  then  the  original  basis  better  have  dimension  rn  and  the  functions  better 

be  fixed  on  each  conjugacy  class.  For  all  practical  purposes,  the  variables  range  over  the 
conjugacy  classes  of  W  rather  than  the  individual  elements.  Having  each  element  be  its  j 

own  conjugacy  class  would  make  life  much  nicer;  this  happens  exactly  when  W  is  an  abelian 
group.  A  result  from  algebra  tells  us  that  any  finite  abelian  group  isomorphic  to  the  direct 
product  of  cyclic  groups.  A  standard  result  from  group  representation  theory  (eg,  Theorem 
2.4  in  Ledermann  [12])  tells  us  exactly  what  the  simple  characters  of  W  are. 


Lemma  36  Suppose 

W  =  7L/kx  x  7L/k2  x  ...  x  7L/ka 
Then  the  simple  characters  ofW  are  the  {xu,  :  w  6  W},  where 


Xw(x) 


So  we  can  define  <f>(a,b)  to  be  Xa(b)  and  obtain  an  orthogonal  transform  for  P{W,  W) 
and  hence  for  F{  Wn,  W'). 

Corollary  37  Suppose  W  is  a  finite  abelian  group  and  <f>  is  the  orthogonal  transform  of 
p(Wn,W')  induced  by  the  simple  characters  of  W .  Theorem  34  and  Theorem  35  hold  for 
W  and  <f>. 


The  fixed  point  property  for  the  Boolean  parity  transform  is  just  Corollary  37  with 
W  =  2/2. 

4.  Further  Work 


This  work  suggests  a  couple  of  unanswered  questions. 

First,  for  completeness’  sake,  we  wonder  whether  the  converse  to  Theorem  35  is  true: 
that  (j>  is  the  easiest  fixed  point. 

Conjecture  38  Let  C  be  a  complexity  class  and  <f>  a  sufficiently  nice  orthogonal  transfor¬ 
mation.  Then  if  there  exist  g,h  €  C  with  F^g  =  ch  then  <f>  6  C . 


12 


In  the  Boolean  parity  case,  the  parity  spectra  had  fixed  points  for  classes  that  contained 
parity  but  yielded  meaningful  invariants  for  classes  that  didn’t — in  particular,  for  ACO. 
Proving  this  conjecture  would  provide  theoretical  evidence  that  the  <f>  spectra  will  yield 
similar  invariants  for  more  general  classes.  What  these  clases  are,  and  whether  the  invariants 
tell  us  anything  interesting,  is  another  question  altogether,  and  one  which  we  will  explore 
shortly. 

The  second  avenue  for  further  inquiry  is  generalizing  the  family  of  <j>  to  which  our  theorem 
applies.  The  multiplicative  property  is  rather  limiting:  we  never  move  beyond  multiplication 
in  C.  However,  in  principle  we  only  need  some  kind  of  self-similarity  between  <t>  on  larger 
domains  and  <f>  on  smaller  ones.  The  relation  does  not  really  have  to  be  multiplicative. 
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